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Abstract —We study classical source coding with quantum side- 
information where the quantum side-information is observed by 
a helper and sent to the decoder via a classical channel. We derive 
a single-letter characterization of the achievable rate region for 
this problem. The direct part of our result is proved via the mea¬ 
surement compression theory by Winter. Our result reveals that 
a helper’s scheme that separately conducts a measurement and 
a compression is suboptimal, and the measurement compression 
is fundamentally needed to achieve the optimal rate region. 

E Introduction 

Source coding normally refers to the information processing 
task that aims to reduce the redundancy exhibited when 
multiple copies of the same source are used. In establishing in¬ 
formation theory. Shannon demonstrated a fundamental result 
that source coding can be done in a lossless fashion; namely, 
the recovered source will be an exact replica of the original 
one when the number of copies of the source goes to infinity 
if!! . If representing the source by a random variable X with 
output space X and distribution px, lossless source coding is 
possible if and only if the compression rate R is above its 
Shannon entropy: 

R>H(X), (1) 

where H(X) := Exe* ~Px{x) log p x {x). 

Redundancy can also exist in the scenario in which multiple 
copies of the source are shared by two or more parties 
that are far apart. Compression in this particular setting is 
called distributed source coding, which has been proven to be 
extremely important in the internet era. The goal is to minimise 
the information sent by each party so that the decoder can 
still recover the source faithfully. Shannon’s lossless source 
coding theorem can still be applied individually to each party. 
However, it is discovered that a better source coding strategy 
exists if the sources between different parties are correlated. 
Denote X and Y the sources held by the two distant parties, 
where the joint distribution is Pxy and the output spaces are 
X and y, respectively. Slepian and Wolf showed that lossless 
distributed source coding is possible when the compression 
rates R\ and IP for the two parties satisfy d: 


Ri > H(X\Y), 

(2) 

R 2 > H(Y\X), 

(3) 

Ri+R 2 > H(XY), 

(4) 


where H{X\Y) is the conditional Shannon entropy. This 
theorem is now called the classical Slepian-Wolf theorem 
El. In particular, when source Y is directly observed at the 


decoder, the problem is sometimes called source coding with 
(full) side-information. 

Another commonly encountered scenario in a communica¬ 
tion network is that a centralised server exists and its role is 
to coordinate all the information processing tasks, including 
the task of source coding, between the nodes in this network. 
Obviously, the role of the server is simply as a helper and it is 
not critical to reproduce the exact information communicated 
by the server. This slightly different scenario results in a 
completely different characterisation of the rate region, as 
observed by Wyner a and Ahlswede-Korner 0. Consider 
that the receiver wants to recover the source X with the 
assistance of the server (that we will call a helper from now 
on) holding Y, where the distribution is Pxy- Wyner showed 
that the optimal rate region for lossless source coding of X 
with a classical helper Y is the set of rate pairs (R,\. R 2 ) such 
that 

Ri > H{X\U), (5) 

R 2 >I(U-,Y), ( 6 ) 

for some conditional distribution Pu\y(, u |y), and I{U;Y) is 
the classical mutual information between random variables U 
and Y. When there is no constraint on Ip (i.e. R 2 can be as 
large as it can be), this problem reduces to source coding with 
(full) side-information. 

The problem of source coding, when replacing classical 
sources with quantum sources, appears to be highly nontrivial 
in the first plac^j. The first quantum source coding theorem 
was established by Schumacher 0,0. A quantum source pa 
can be losslessly compressed and decompressed if and only if 
the rate R is above its von Neumann cntrop\Q: 

R > H{A) P , (7) 

where H(A) P := - Trp^ logpA- 

Schumacher’s quantum source coding theorem bears a close 
resemblance to its classical counterpart. One will naturally 
expect that the same will hold true for the distributed source 
coding problem in the quantum regime. Consider that Alice, 
who has the quantum system A of an entangled source pab, 
would like to merge her state to the distant party Bob. Then, 
the rate R at which quantum states with density matrix p,\ can 
be communicated to a party with quantum side information pb 

'The quantum source coding result takes a much longer time to develop if 
one considers that quantum theory began to evolve in the mid-1920s. 

2 The subscript A is a label to which the quantum system pA belongs. 


is given by the conditional von Neumann entropy H(A\B) p , 
a simple observation followed from the classical Slepian-Wolf 
theorem. While this naive conclusion turns out to be correct, 
this result has a much deeper and profound impact in the 
theory of quantum information as it marks a clear departure 
between classical and quantum information theory. It is rather 
perplexing that the rate R is quantified by the conditional 
entropy H(A\B) p , which can be negative. This major piece 
of the puzzle was resolved with the interpretation that if the 
rate is negative, the state can be merged, and in addition, the 
two parties will gain \H(A\B) p \ amount of entanglement for 
later quantum communication 0, 0, iflOl . The distributed 
quantum source coding problem was later fully solved DU, 
02 where the trade-off rate region between the quantum 
communication and the entanglement resource is derived. The 
result is now called the fully quantum Slepian-Wolf theorem 
(FQSW). 

Source coding with hybrid classical-quantum systems pxB 
with X representing a classical system and B a quantum state 
is also considered in quantum information theory, and our 
result falls into this category. In fl3l . Devetak and Winter con¬ 
sidered classical source coding with quantum side information 
at the decoder, and showed that the optimal rate R\ is given by 
H(X\B) p . This result can be regarded as a classical-quantum 
version of the source coding with (full) side-information. 

In this work, we consider classical source coding with a 
quantum helper, a problem that was completely overlooked 
before. In our problem, the quantum side-information is ob¬ 
served by the helper, and the decoder will only have a classical 
description from the quantum helper. Although our problem 
can be regarded as a classical-quantum version of the classical 
helper problem studied in 0, 0, in contrast to its classical 
counterpart, our problem does not reduce to source coding 
with quantum side-information studied in 031 even if there is 
no constraint on rate f? 2 - However, when the ensemble that 
constitutes the quantum side-information is commutative, our 
problem reduces to the classical helper problem. 

We completely characterize the rate region of the quantum 
helper problem. In fact, the formulae describing the rate region 
(cf. Theorem Q} resembles its classical counterpart (cf. © 
and ©). However, the proof technique is very different due 
to the quantum nature of the helper. In particular, we use 
the measurement compression theory by Winter |22| in the 
direct coding theorem. One of interesting consequences of 
our result is that a helper’s scheme that separately conducts a 
measurement and a compression is suboptimal; measurement 
compression is fundamentally needed to achieve the optimal 
rate region. 

There are a huge amount of work devoted to both classical 
and quantum lossy source coding {141 , fl5l . Iff6l . lfi~7l . fTSl , 
ED. However, we will restrict ourselves to only noiseless 
source coding in this work. 

Notations. In this paper, we will use capital letters 
X, Y. Z. U etc. to denote classical random variables, and lower 
cases x, y , z, u to denote their realisations. We use X , y, Z,U 
to denote the sample spaces. We denote x n = X\X2 • • • x n . 



Fig. 1. Source Compression with a Quantum Helper. 


A quantum state is a positive semi-definite matrix with trace 
equal to one. We will use p or a to denote a quantum system 
in this paper. In case we need to specify which party the 
quantum state belongs to, we will use a subscript description 
PA, meaning that the quantum system is held by A(lice). 
Letting {|a;)(a:|} x e;t be a set of orthonormal basis vectors, 
a classical-quantum state pxB is written as 

Pxb = ^2px(x)\x)(x\ g> p x , 

X 

so that n copies of it is 

pTB = T,Px ) ^ n )K)(x n \^ P x^ 

x n 

where we denote p x n := p Xl (g) • • ■ (g) p Xri for the sequence x n . 
A positive-operator valued measure (POVM), A = {A, y }, is a 
quantum measurement whose elements are non-negative self- 
adjoint operators on a Hilbert space so that g y A y = I. 

This paper is organised as follows. In Sec |lll we formally 
define the problem of source coding with a quantum helper, 
and present the main result as well as its proof. We conclude 
in Sec ED with open questions. 

II. Classical Source Compression with a Quantum 
Helper 

As shown in Figure 0 the protocol for classical source 
coding with a quantum helper involves two senders, Alice 
and Bob, and one receiver, Charlie. Initially Alice and Bob 
hold n copies of a classical-quantum state pxn. In this 
case, Alice holds classical random variables X n while Bob 
(being a helper) holds a quantum state px>> that is correlated 
with Alice’s message. The goal is for the decoder Charlie 
to faithfully recover Alice’s message when assisted by the 
quantum helper Bob. 

We now proceed to formally define the coding procedure. 
We define an (n, e) code for classical source compression with 
a quantum helper to consist of the following: 

• Alice’s encoding operation ip : X n —> A4, where A4 := 
{1,2,- •• ,|7W|} and \M\ = 2 nR 

. Bob’s POVM A = {A f } : B n £, where C := 
{1,2,--- ,\C\} and \C\ = 2"* 2 ; 

• Charlie’s decoding operation T> : JA x C —> X n 
so that the error probability satisfies 

Pr{X n ± X n } < e. (8) 













A rate pair (Ri,R 2 ) is said to be achievable if for any 
e, S > 0 and all sufficiently large n, there exists an (n, e) code 
with rates R\ + 5 and R 2 + S. The rate region is then defined 
as the collection of all achievable rate pairs. Our main result 
is the following theorem. 

Theorem 1: Given is a classical-quantum source pxB- The 
optimal rate region for lossless source coding of X with a 
quantum helper B is the set of rate pairs ( H \. R 2 ) such that 


i?i > H{X\U) 

(9) 

R 2 >I(U-,B)„. 

(10) 

The state ctub( A) resulting from Bob’s application of the 

POVM A = {A u} u m is 


O’UB (A) = ^2 Pu(u)\u)(u\ <g) p u 

(11) 

uEU 


where 


Pu(u) = Tr(p s A„) 

(12) 

Pu — / , [v PB^-uy/P b\ 

pu{u) 

(13) 

PB = y^/px(x)p x . 

X 

(14) 

where * denotes complex conjugation in the standard basis. 

Furthermore, we can restrict the size of POVM as 
where ds is the dimension of Bob’s system. 

\U\ < d 2 B , 

A typical shape of the rate region in Theorem[T]is described 
in Fig. |2 When there is no constraint on R 2 , rate R\ can be 

decreased as small as 


H(X\U*) := min H(X\TT) 

(15) 

= H(X) — max/(X; U) 

(16) 

= H{X) - 7 acc , 

(17) 


where / acc is the accessible information for the ensemble 
{(px{x), Px)}xex- Unless the ensemble commutes 0 , the 
minimum rate H(X\U*) is larger than the rate H(X\B) p , 
which is the optimal rate in the source coding with quantum 
side-information lH3l . To achieve R\ = H(X\U*), it suffices 
to have R 2 > I(U*\B) a , which is smaller than H(U*) in 
general. This means that the following separation scheme is 
suboptimal: first conduct a measurement to get U* and then 
compress U*. For more detail, see the direct coding proof. 

Converse: 

Let Lp : X n —> Xi be Alice’s encoder, and let {Abe 
Bob’s measurement. Alice sends M = cp(X n ) to the decoder, 
and Bob sends the measurement outcome L to the decoder. 
The Fano’s inequality states that H(X n \M, L) < ne n for 
some e n —> 0 as n —> oo. 


R2 



Fig. 2. A typical shape of the rate region in Theorem |T| 


First, we have the following bound: 


log \M\ > H{M ) 

(18) 

> H(M\L) 

(19) 

> H{X n \L) — H(X n \M, L) 

(20) 

> H(X n \L) — ne n 

(21) 

( b ) ” 

> ^i7(X t | X< t ,L)-ne n 

t= 1 

(22) 

n 

t= l 

(23) 

—^ nH{Xj\Uj, J) — ne„, 

(24) 


where (a) follows from Fano’s inequality: H(X n \M, L) < 
ne n for some e n —> 0 as n —> oo; in (b), we use chain rule 
and denote X <t := (Xi,... ,X t -i)\ in (c), we denote Ut := 
(X <t: L); in (d), we introduce a time-sharing random variable 
J that is uniformly distributed in the set {1, 2, • • • n}. 

Next, we have 


log \C\ > H(L) 

(25) 

> I{L-B n ) 

(26) 

= Y J I{L-B t \B <t ) 

t= 1 

n 

(27) 

t= 1 

n 

(28) 

t= l 

n 

(29) 

>^I(L,X <t -,B t ) 

t= 1 

n 

(30) 

t= i 

(31) 








where (a) follows from 


I(X <t -B t \L,B <t ) < I(X <t] B t ,B >t \L,B <t ) ( 32 ) 

= H(X <t \L, B <t ) - H(X <t \L, B n ) 

( 33 ) 

< H(X <t \B <t ) - H(X <t \L, B n ) ( 34 ) 

= H(X <t \B <t ) - H(X <t \B n ) ( 35 ) 

= H(X <t \B <t ) - H(X <t \B <t ) ( 36 ) 

= 0 . ( 37 ) 

Following from Eq. ( 13 1 1 . we can again introduce a time¬ 
sharing random variable J that is uniformly distributed in the 
set {1, 2, • • • , n}, 

n n 

Y J I{UuB t ) = nY J I{Ut,B t \J = t) ( 38 ) 

t= 1 t =1 

= nI(Uj] Bj\J) ( 39 ) 

= nI(UjJ ; Bj) ( 40 ) 


where the last equality follows because J(J; Bj) = 0. To get 
single-letter formula, define X = Xj, B = Bj , and U = 
( Uj , J) and let n —> oo: 


Ri = -\og\M\>H(X\U) (41) 

n 

R 2 = — log \C\ > I(U ; B). (42) 

n 

Here, we note that the distribution of Ut = (L,X <t ) can 
be written as 


Px <t L(x <t ,£) 



x 


Tr 



(43) 


Thus, we can get Ut as a measurement outcome of B t by first 
generating X <t , then by appending (g) i<t p Xi and (X) i>t p Bi to 
ancillae systems, and finally by conducting the measurement 

{h-z}tec- 

Finally, the bound on \U\ can be proved via Carathodory’s 
theorem (cf. lt25l. Appendix C]). 


Direct Coding Theorem: Fix a POVM measurement A = 
{A u } U £U- It induces a conditional probability Pu\xi u \ x ) = 
Tr[A u/ o x ], and joint probability distribution 

Pxu(x,u) =px(x)pu\ x {u\x). (44) 

The crucial observation is the application of Winter’s mea¬ 
surement compression theory f22l . 

Theorem 2 (Measurement compression theorem [22], [23]): 
Let pa be a source state and A a POVM to simulate on 
this state. A protocol for a faithful simulation of the POVM 
is achievable with classical communication rate R and 
common randomness rate S if and only if the following set 
of inequalities hold 


R>I{X;R), R + S > H (X ), 


where the entropies are with respect to a state of the following 
form: 

^]|a;}(ir| A <g) Tr A {(l fl ® Aj 1 ) 0^} , (46) 

X 

and (f> RA is some purification of the state pa- 

Let K be a random variable on /C, which describes the 
common randomness shared between Alice and Bob. Let 
{A^}^ be collection of POVMs. Let 

Q n xu(x n ,u n ) := Pjp\x n ) £ ±Tr[p xn Ai% (47) 

where P^\x n ) := Px{xi)x ■ ■ -xPx{x n ). The faithful simu¬ 
lation of n copies of POVM A := {A„} ue ^, i.e. A® n , implies 
that for any e > 0, there exists n sufficiently large, such that 
there exist POVMs {A^}, where A ^ := {A ? ^ } u n eu n , with 

\\\P { xl-Q n xuh<z- m 

Coding Strategy: 

Alice and Bob shared n copies of the state pxB, and 
assume that Bob performs measurement A® n : B® n U n 
on his quantum system whose outcome is sent to the decoder 
to assist decoding Alice’s message. Bob’s measurement on 
each copy of pxs will induce the probability distribution 
Pxu according to ©. Apparently, if Bob sends the full 
measurement outcomes to Charlie (say nH(U) bits), then 
Charlie can successfully decode X n simply from Slepian-Wolf 
Theorem. The next strategy is to make use of classical result 
since after Bob’s measurement, Alice and Bob become fully 
classical with joint distribution Pxu■ Therefore, the minimum 
rate for Bob is I(V;U) (w.r.t. some conditional distribution 
Pv\ui v \ u ))- However, there is a non-trivial quantum coding 
strategy. Detail follows. 

Bob’s coding. Instead of the measurement A performed 
on Bob’s system prs and coding w.r.t. the classical channel 
Pv\ui v \ u )’ th e decoder Charlie can directly simulate the 
measurement outcome U using Winter’s measurement com¬ 
pression theorem |i|22|. |23|. Denote Bob’s classical communi¬ 
cation rate R 2 = A max^.g^; |. Then Theorem [2] promises 
that by sending R 2 > / ( U : B) from Bob to the decoder 
Charlie, Charlie will have a local copy U n and the distribution 
between Alice and Charlie Q" ~ will satisfy ( |48| >. 

Alice’s coding. Now Alice’s strategy is very simple since 
Charlie has had U n . She just uses the Slepian-Wolf coding 
strategy as if she starts with the distribution Pxu with Charlie. 
In fact, it is well known (cf. Il20l ) that there exists an encoder 
tp : X n —> M and a decoder V : M x U n —t X n such that 
\M\ = 2 n W*l [/ )+ 5 ) and 

P ( xiM°) < e (49) 

for sufficiently large n, where 

A := {(a: n , u n ) G X n x U n : V(<p(x n ), u n ) = x n } (50) 


(45) 


is the set of correctably decodable pairs. 




Now, suppose that Alice and Bob use the same code for 
the simulated distributio n Q” .~. Then, by the definition of the 
variational distance and (148b . we have 

Q n x( j{A c )<P^{A c ) + e. (51) 

Thus, if we can find a good code for we can also use 

that code for Q" ~ for sufficiently large n. 

y\. U 

Derandomization. The standard derandomization technique 
works here. Since the distribution = j^y E,kelC Qxu\k’ 
and 

E = QZoW £ Wfl + ®> 

Thus, there exists one k £ 1C so that (^4°) is small. 

■ 

III. Conclusion and Discussion 

We considered the problem of compression of a classical 
source with a quantum helper. We completely characterised 
its rate region and showed that the capacity formula does not 
require regularisation, which is not common in the quantum 
setting. While the expressions for the rate region are similar 
to the classical result in (3), 0, |2T1 . it requires vey different 
proof technique. To prove the achievability, we employed a 
powerful theorem, measurement compression theorem |221, 
that can decompose quantum measurement. A similar ap¬ 
proach was recently applied to derive a non-asymptotic bound 
on the classical helper problem (24). 

This work brings more questions than answered. As we 
have pointed out, source coding with a helper was never 
considered in the quantum regime before ours. Our work 
can be served as the first step to the more general (fully 
quantum) setting; namely, quantum source coding with a 
quantum helper. Currently, it is completely unknown how 
to quantify the distinction between side information and a 
quantum helper. We believe that resolving this question will 
sharpen our understanding of a quantum source. 
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